Mental Health Provider Reach and Engagement in a Countywide Training Initiative.

Many training initiatives are underway to increase implementation of evidence-based practice (EBPs) in mental healthcare. However, little is known about what types of trainings and supports yield the highest reach and engagement. Supported by a tax-funded, countywide initiative to improve access to quality care for youths, the current mixed methods study evaluates mental health (MH) provider reach, or registering for the training initiative, and engagement, or participation in training activities, for several EBP training and implementation supports. MH providers were offered free 1) formal EBP workshops, 2) a biweekly learning community, 3) individual case consultation, and 4) confidential online clinical feedback system. To register, interested providers (N = 698) completed a web-based assessment measuring clinical practice information, organizational implementation climate, and EBP knowledge, attitudes, and practices. Thirteen providers, selected via purposeful sampling stratified by level of participation, completed semi-structured qualitative interviews. While the training initiative achieved high reach (66% of county agencies had a provider register), far fewer providers engaged substantially in training. Quantitative results indicated that providers whose professional discipline was not psychology, had higher baseline EBP knowledge, more extensive use of common evidence-based strategies, and less extensive use of other therapy strategies, engaged in more training. Rapid qualitative analysis of interviews expanded upon these findings and illuminated provider, organizational, system, practical, and training activity-specific barriers and facilitators to engagement. Findings suggest the importance of identifying strategies for improving provider engagement in training activities beyond workshops. Implications for future research and training initiatives are discussed.

A Structural Model of Organization and Clinician Factors Associated with Standardized Measure Use in a National Survey of Youth Mental Health Providers.

Standardized assessment measures are important for accurate diagnosis of mental health problems and for treatment planning and evaluation. However, little is known about youth mental health providers' typical use of standardized measures across disciplines and outside the context of evidence-based practice initiatives. A multidisciplinary national survey examined the frequency with which 674 youth mental health providers administer standardized and unstandardized measures, and the extent to which organizational (i.e., implementation climate, rigid hierarchical organizational structure) and provider (i.e., attitudes toward standardized assessment measures, highest degree, practice setting) characteristics are associated with standardized measure use. Providers used unstandardized measures far more frequently than standardized measures. Providers' perceptions (a) that standardized measures are practical or feasible, (b) that their organization supports and values evidence-based practices, and (c) that their organization has a rigid hierarchical structure predicted greater use of standardized measures. Working in schools predicted less frequent SMU, while working in higher education and other professional settings predicted more frequent SMU. Standardized measures were not routinely used in this community-based sample. A rigid hierarchical organizational structure may be conducive to more frequent administration of standardized measures, but it is unclear whether such providers actually utilize these measures for clinical decision-making. Alternative strategies to promote standardized measure use may include promoting organizational cultures that value empirical data and encouraging use of standardized measures and training providers to use pragmatic standardized measures for clinical decision making.

Characterizing supervision-as-usual: Findings from two provider surveys.

Although clinical supervision is widely seen as critical for professional training and for safeguarding and promoting client well-being in mental health care, it is understudied, particularly in publicly funded services. In surveys of two large samples of youth mental health service providers (a state sample of providers billing Medicaid [N = 1,057] and a national sample of professional guild members [N = 1,720]), we examined the amount of time providers reported spending in supervision and consultation in a typical workweek and its covariation with characteristics of providers' caseloads and work settings. Across both samples, providers reported spending an average of 2-3 hr per week in supervision. Serving higher percentages of low-income clients was associated with significantly more supervision time. Working in private practice was associated with less supervision, while community mental health and residential facilities were each associated with more supervision time. The national survey also measured providers' perceptions of their current supervision. On average, providers endorsed feeling comfortable with the amount of supervision received and supported by their supervisors. However, working with more low-income clients was associated with greater need for supervisor approval and oversight and with less comfort in the amount of supervision received. Those working with more low-income clientele may benefit from additional supervision time or more focused supervision coverage of the specific needs of clients with low-income. More in-depth research on critical processes and content in supervision is a much-needed future direction for supervision research. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Implementation of a Low-Cost, Multi-component, Web-Based Training for Trauma-Focused Cognitive-Behavioral Therapy.

Effective, interactive trainings in evidence-based practices remain expensive and largely inaccessible to most practicing clinicians. To address this need, the current study evaluated the impact of a low-cost, multi-component, web-based training for Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT) on clinicians' TF-CBT knowledge, strategy use, adherence and skill. Clinician members of a practice-based research network were recruited via email and randomized to either an immediate training group (N = 89 assigned) or waitlist control group (N = 74 assigned) that was offered access to the same training after six months, with half of each group further randomized to receive or not receive incentives for participation. Clinicians completed assessments at baseline, 6 months, and 12 months covering TF-CBT knowledge, strategy use, and for a subset of clinicians (n = 28), TF-CBT adherence and skill. Although significant differences in overall TF-CBT skillfulness and readiness were found, there were no significant differences between the training and waitlist control group on TF-CBT knowledge and strategy use at six months. However, there was considerable variability in the extent of training completed by clinicians. Subsequent post-hoc analyses indicated a significant, positive association between the extent of training completed by clinicians and clinician TF-CBT knowledge, strategy use, demonstrated adherence and skill across the three TF-CBT components, and overall TF-CBT readiness. We also explored whether incentives predicted training participation and found no differences in training activity participation between clinicians who were offered an incentive and those who were not. Findings highlight the limitations of self-paced web-based trainings. Implications for web-based trainings are discussed.

Measuring Evidence-Based Treatment Strategies in Youth Community Mental Health Care: the Evidence-Based Strategies Scale.

While there are established measures for fidelity to specific evidence-based treatments, there is no widely accepted, feasible measure of the use of evidence-based treatment strategies in youth mental health (MH) care. This study examined the factor structure of a provider self-report measure of evidence-based treatment strategy use, the Evidence-Based Strategies Scale (EBSS). MH providers completed the EBSS as part of a larger mailed survey. The factor structure of the EBSS was examined using exploratory factor analysis in a national, multidisciplinary sample of MH providers (N = 1092), and confirmatory factor analysis was subsequently conducted to replicate this factor structure in a state-wide, multidisciplinary sample of Medicaid MH providers (N = 780). Findings indicated a three-factor structure, representing working alliance, youth-focused, and family-focused evidence-based treatment strategies factors. The EBSS offers a potential method for measuring the evidence-based treatment strategies being delivered in youth community MH care, though more research is needed.

Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale.

There is a well-documented gap between research and practice in the treatment of mental health problems. One promising approach to bridging this gap is training community-based providers in evidence-based practices (EBPs). However, a paucity of valid, reliable measures to assess a range of outcomes of such trainings impedes our ability to evaluate and improve training toward this end. The current study examined the factor structure of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a provider-report measure that assesses three perceptual implementation outcomes of trainings that may be leading indicators of training success (i.e., acceptability, feasibility, and appropriateness). Providers who attended half-day EBP trainings for common mental health problems reported on the acceptability, feasibility, and appropriateness of these trainings using the AFAS (N = 298). Confirmatory factor analysis indicates good fit to the hypothesized three-factor structure (RMSEA = .058, CFI = .990, TLI = .987). Acceptability, feasibility, and appropriateness were three distinct but related constructs. Cronbach's alpha ranged from .86 to .91, indicating acceptable internal consistency for the three subscales. Acceptability and feasibility, but not appropriateness, scores varied between workshops, though variability across workshops was generally limited. This initial evaluation of the AFAS is in line with recent efforts to enhance psychometric reporting practices for implementation outcome measures and provides future directions for further development and refinement of the AFAS. Plain Language Summary: Clinician training in evidence-based practices is often used to increase implementation of evidence-based practices in mental health service settings. However, one barrier to evaluating the success of clinician trainings is the lack of measures that reliably and accurately assess clinician training outcomes. This study was the initial evaluation of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a measure that assesses the immediate outcomes of clinician trainings. This study found some evidence supporting the AFAS reliability and its three subscales. With additional item refinement and psychometric testing, the AFAS could become a useful measure of a training's immediate impact on providers.

Role-Play Assessment of Therapist Adherence and Skill in Implementation of Trauma-Focused Cognitive-Behavioral Therapy.

Numerous efforts are underway to train clinicians in evidence-based practices. Unfortunately, the field has few practical measures of therapist adherence and skill with which to judge the success of these training and implementation efforts. One possible assessment method is using behavioral rehearsal, or role-play, as an analogue for therapist in-session behavior. The current study describes aspects of reliability, validity and utility of a behavioral role-play assessment developed to evaluate therapist adherence and skill in implementing Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT). TF-CBT role-play assessments were conducted with a sample of 43 therapists as part of a larger training study. The TF-CBT role-play assessments were independently coded for TF-CBT adherence and skill by a certified TF-CBT trainer and three clinical psychology doctoral students. Findings indicated good interrater reliability for the individual items (ICC: M = .71, SD = .15). Regarding utility, 67.19% (n = 43/64) of contacted therapists completed the role-play assessment, which took an average of 30 min (M = 31.42, SD = 5.65) to complete and 60 min (M = 62.84, SD = 11.31) to code. Therapists with a master's degree were more likely to complete the role-play assessment than those with other degrees but no other differences in demographic variables, practice characteristics, or TF-CBT knowledge or training were found between participants and nonparticipants. Role-play assessments may offer an alternative to observational coding for assessing therapist adherence and skill, particularly in contexts where session recordings are not feasible.

A mixed-method evaluation of the adoption and implementation of the College Alcohol Intervention Matrix among prevention experts: a study protocol.

BACKGROUND: Risky drinking among college campuses has been a long-standing concern and there have been dedicated efforts to develop evidence-based prevention and treatment strategies (EBSs) to decrease alcohol use and increase healthy behaviors among college students. Further, the College Alcohol Intervention Matrix (CollegeAIM) was developed as a tool with accompanying resources, to assist institutions of higher education in selecting EBSs that are appropriate and a good fit for their campuses. However, the CollegeAIM tool and selection of prevention strategies from stakeholders' perspectives has yet to be evaluated. This study protocol describes the methodology for a research project evaluating CollegeAIM from an implementation science perspective using the Exploration, Preparation, Implementation, and Sustainment framework. METHODS: The aims of this study will be accomplished with a mixed-method design comprised of reviews of strategic planning documents, quantitative surveys and interviews with prevention experts, and focus groups to identify key components of a decision-support program for prevention experts to support the use of CollegeAIM. Participants are members of the multi-site Missouri Partners in Prevention coalition to reduce risky substance use on college campuses across the state. DISCUSSION: The results of this study will provide key information to support the development of additional supportive tools for campuses that can improve their selection and implementation of EBSs that fit the needs of their respective campuses. This work is important to further advance the implementation and sustainment of extant EBSs for risky college alcohol use.

A Second and Third Look at FIRST: Testing Adaptations of A Principle-Guided Youth Psychotherapy.

Objective: We examined the acceptability, integrity, and symptom trajectories associated with FIRST, a principle-guided treatment for youth internalizing and externalizing problems designed to support efficient uptake and implementation.Method: We conducted two open trials of an adapted FIRST, focusing on uptake and implementation by novice trainees in a university-affiliated clinic, limiting treatment duration to six sessions, and benchmarking findings against a 2017 FIRST trial with community therapists. In Study 1, trainees received a two-day training and weekly two-hour supervision (N = 22 youths, ages 7-17, 50% female, 54.54% Caucasian, 4.55% Latinx). In Study 2, trainees received a one-day training and weekly one-hour supervision, delivering the six-session FIRST in a predetermined sequence (N = 26 youths, ages 11-17, 42.31% female, 65.38% Caucasian, 7.69% Latinx). In Study 3, the original study therapists - now practitioners - evaluated FIRST's effectiveness and implementation difficulty, and reported their own post-study FIRST use.Results: Acceptability (treatment completion, session attendance, caregiver participation) and integrity (adherence, competence) were comparable across Study 1, Study 2 and the 2017 trial. Improvement effect sizes across ten outcome measures were in the large range in all three trials: M ES = 1.10 in the 2017 trial, 0.83 in Study 1, and 0.81 in Study 2. Study 3 showed high effectiveness ratings, low difficulty ratings, and continued use of FIRST by a majority of clinicians.Conclusions: Across two open trials and a follow-up survey, FIRST showed evidence of acceptability and integrity, with youth symptom reduction comparable to that in prior research.

Evidence-Based Assessment in Routine Mental Health Services for Youths.

OBJECTIVE: Evidence-based assessment (EBA) plays a critical role in the delivery of effective treatments. However, little is known about the assessment practices of mental health clinicians who treat youths and the factors that support EBA. The authors examined when, how, and under what conditions clinicians conduct EBA. METHODS: In two multidisciplinary surveys (combined N=2,575), clinicians reported how frequently they conducted pretreatment, ongoing, and posttreatment assessments and how frequently they used standardized measures in usual care of youths. RESULTS: Although clinicians reported frequent pretreatment, ongoing, and posttreatment assessments, use of standardized measures was rare. Clinician and practice setting characteristics predicted standardized measure use, and a lack of practical assessment tools appears to be a barrier to use of standardized measures in EBA of youths. CONCLUSIONS: Many clinicians conduct assessments during treatment, but more practical measures and clinician training may improve the integration of standardized measures into routine practice.

The Missouri Prevention Center: A multidisciplinary approach to reducing the societal prevalence and burden of youth mental health problems.

The challenges presented by the growing prevalence, burden, and unmet service needs of youth mental health problems are formidable. During the past decade, scholars and other stakeholders of the Missouri Prevention Center (MPC) have been using a prevention and implementation science approach to develop, implement, evaluate, and disseminate recommended practices in promoting youth mental health in real world contexts. The purpose of this article is to describe the multidisciplinary contributions of MPC to improve the social, emotional, and behavioral health of youth, locally and nationally. We briefly summarize MPC scholarship that has addressed the individual and social-contextual risk and protective factors of youth mental health at home, school, and community. The article concludes with a description of two large-scale community projects, funded by an innovative local sales tax, that represent the systematic application of MPC scholarship and outreach. Together these projects provide mental health screening for every youth in our county three times per year and a single point of entry into the mental health service system where any family in our county can access an evaluation and referral for their child at no cost to them. The projects serve as model demonstrations for how communities can address the challenges of youth mental health concerns through multidisciplinary collaborations. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Evidence-Based Treatment Strategies in Youth Mental Health Services: Results from a National Survey of Providers.

Previous surveys indicate infrequent use of evidence-based treatment (EBT) manuals in usual care youth mental health, but the extent to which providers use core and common EBT strategies and what contextual factors impact EBT strategy implementation need further study. In a national, multidisciplinary survey of 1092 youth-serving providers, providers reported regular use of many EBT strategies. Provider learning theory orientation, more recent degree, more standardized and ongoing assessment use, more positive attitudes toward innovation and evidence, fewer low-income clients, and perceptions that their agency valued quality care and provided fewer training resources predicted more frequent EBT strategy use.

Monitoring Treatment Progress and Providing Feedback is Viewed Favorably but Rarely Used in Practice.

Numerous trials demonstrate that monitoring client progress and using feedback for clinical decision-making enhances treatment outcomes, but available data suggest these practices are rare in clinical settings and no psychometrically validated measures exist for assessing attitudinal barriers to these practices. This national survey of 504 clinicians collected data on attitudes toward and use of monitoring and feedback. Two new measures were developed and subjected to factor analysis: The monitoring and feedback attitudes scale (MFA), measuring general attitudes toward monitoring and feedback, and the attitudes toward standardized assessment scales-monitoring and feedback (ASA-MF), measuring attitudes toward standardized progress tools. Both measures showed good fit to their final factor solutions, with excellent internal consistency for all subscales. Scores on the MFA subscales (Benefit, Harm) indicated that clinicians hold generally positive attitudes toward monitoring and feedback, but scores on the ASA-MF subscales (Clinical Utility, Treatment Planning, Practicality) were relatively neutral. Providers with cognitive-behavioral theoretical orientations held more positive attitudes. Only 13.9 % of clinicians reported using standardized progress measures at least monthly and 61.5 % never used them. Providers with more positive attitudes reported higher use, providing initial support for the predictive validity of the ASA-MF and MFA. Thus, while clinicians report generally positive attitudes toward monitoring and feedback, routine collection of standardized progress measures remains uncommon. Implications for the dissemination and implementation of monitoring and feedback systems are discussed.

What five decades of research tells us about the effects of youth psychological therapy: A multilevel meta-analysis and implications for science and practice.

Across 5 decades, hundreds of randomized trials have tested psychological therapies for youth internalizing (anxiety, depression) and externalizing (misconduct, attention deficit and hyperactivity disorder) disorders and problems. Since the last broad-based youth meta-analysis in 1995, the number of trials has almost tripled and data-analytic methods have been refined. We applied these methods to the expanded study pool (447 studies; 30,431 youths), synthesizing 50 years of findings and identifying implications for research and practice. We assessed overall effect size (ES) and moderator effects using multilevel modeling to address ES dependency that is common, but typically not modeled, in meta-analyses. Mean posttreatment ES was 0.46; the probability that a youth in the treatment condition would fare better than a youth in the control condition was 63%. Effects varied according to multiple moderators, including the problem targeted in treatment: Mean ES at posttreatment was strongest for anxiety (0.61), weakest for depression (0.29), and nonsignificant for multiproblem treatment (0.15). ESs differed across control conditions, with "usual care" emerging as a potent comparison condition, and across informants, highlighting the need to obtain and integrate multiple perspectives on outcome. Effects of therapy type varied by informant; only youth-focused behavioral therapies (including cognitive-behavioral therapy) showed similar and robust effects across youth, parent, and teacher reports. Effects did not differ for Caucasian versus minority samples, but more diverse samples are needed. The findings underscore the benefits of psychological treatments as well as the need for improved therapies and more representative, informative, and rigorous intervention science. (PsycINFO Database Record

Assessment Practices of Child Clinicians.

Assessment is an integral component of treatment. However, prior surveys indicate clinicians may not use standardized assessment strategies. We surveyed 1,510 clinicians and used multivariate analysis of variance to explore group differences in specific measure use. Clinicians used unstandardized measures more frequently than standardized measures, although psychologists used standardized measures more frequently than nonpsychologists. We also used latent profile analysis to classify clinicians based on their overall approach to assessment and examined associations between clinician-level variables and assessment class or profile membership. A four-profile model best fit the data. The largest profile consisted of clinicians who primarily used unstandardized assessments (76.7%), followed by broad-spectrum assessors who regularly use both standardized and unstandardized assessment (11.9%), and two smaller profiles of minimal (6.0%) and selective assessors (5.5%). Compared with broad-spectrum assessors, unstandardized and minimal assessors were less likely to report having adequate standardized measures training. Implications for clinical practice and training are discussed.

Therapist- and Client-Level Predictors of Use of Therapy Techniques During Implementation in a Large Public Mental Health System.

OBJECTIVE: Many youths receiving community mental health treatment do not receive evidence-based interventions. Research suggests that community mental health therapists use a broad range of therapeutic techniques at low intensities. This study examined the relationship between therapist- and client-level predictors of community-based therapists' report of cognitive, behavioral, psychodynamic, and family techniques within the context of implementation efforts. METHODS: A total of 130 therapists participated from 23 organizations in an urban, publicly funded behavioral health system implementing evidence-based practices. Therapist-level predictors included age, gender, clinical experience, licensure status, and participation in evidence-based practice initiatives. Child-level predictors included therapist-reported child primary disorder (externalizing, internalizing, or other) and child age. Therapists completed the Therapist Procedures Checklist-Family Revised, a self-report measure of therapeutic techniques used. RESULTS: Unlicensed therapists were more likely than licensed therapists to report using psychodynamic and behavioral techniques. Therapists who did not participate in an evidence-based practice initiative were less likely to report use of cognitive techniques. Those with clients with externalizing disorders were more likely to report use of behavioral and family techniques. Therapists with the youngest clients (ages three to seven years) were most likely to report use of behavioral techniques and less likely to report use of cognitive and psychodynamic techniques. CONCLUSIONS: Results suggest that both therapist and client factors predict self-reported use of therapy techniques. Participating in an evidence-based practice initiative was associated with increased reports of using cognitive techniques. Therapists reported using behavioral and family techniques more than other techniques when working with youths with externalizing disorders and using fewer cognitive and psychodynamic techniques with young clients.

Mental Health Clinicians' Participation in Web-Based Training for an Evidence Supported Intervention: Signs of Encouragement and Trouble Ahead.

Comprehensive scalable clinician training is needed to increase the impact of evidence-supported psychotherapies. This study was designed to ascertain clinician participation in different low-cost training activities, what predicts their training participation, and how participation can be increased. The study enrolled 163 clinicians. Of these, 105 completed a follow-up survey and 20 completed a more in-depth qualitative interview. Some activities (web training) attracted greater participation than others (e.g., discussion boards, role playing). Key findings include the desirability of self-paced learning and the flexibility it afforded practicing clinicians. However, some found the lack of accountability insurmountable. Many desired in-person training as a way to introduce accountability and motivation. While low-cost, relevant, self-paced learning appeals to practicing clinicians, it may need to be combined with opportunities for in-person training and accountability mechanisms in order to encourage large numbers of clinicians to complete training.

Predictors of polypharmacy and off-label prescribing of psychotropic medications: a national survey of child and adolescent psychiatrists.

We employed a national survey of child psychiatrists to examine typical prescribing practices for children with anxiety, depression, and disruptive behavior disorders. We examined the extent to which polypharmacy and off-label prescribing occur in routine practice and the degree to which child characteristics, child psychiatrist characteristics, and medication availability may influence these prescribing practices. We found that child psychiatrists most often prescribed medications that were on-label according to U.S. Food and Drug Administration (FDA) guidelines, and that they were progressively less likely to choose medications with partial approval (i.e., medications having pediatric approval but not for the patient's age or problem type), and then medications with no pediatric approval. We also found that prescribing multiple concomitant medications was the norm. We employed best subsets regression to determine the best theoretically relevant predictors to explain polypharmacy and off-label prescribing and found that the best fitting model only included number of child diagnoses. These findings suggest that comorbidity is an important issue in the pharmacotherapy of children with mental health disorders and one that must be addressed in future clinical trials.